Don't Fear the Bit Flips: Optimized Coding Strategies for Binary Classification
نویسندگان
چکیده
After being trained, classifiers must often operate on data that has been corrupted by noise. In this paper, we consider the impact of such noise on the features of binary classifiers. Inspired by tools for classifier robustness, we introduce the same classification probability (SCP) to measure the resulting distortion on the classifier outputs. We introduce a low-complexity estimate of the SCP based on quantization and polynomial multiplication. We also study channel coding techniques based on replication errorcorrecting codes. In contrast to the traditional channel coding approach, where error-correction is meant to preserve the data and is agnostic to the application, our schemes specifically aim to maximize the SCP (equivalently minimizing the distortion of the classifier output) for the same redundancy overhead.
منابع مشابه
Relative error due to a single bit-flip in floating-point arithmetic
We consider the error due to a single bit-flip in a floating point number. We assume IEEE 754 double precision arithmetic, which encodes binary floating point numbers in a 64-bit word [1]. We assume that the bit-flip happens randomly so it has equi-probability (1/64) to hit any of the 64 bits. Since we want to mitigate the assumption on our initial floating-point number, we assume that it is un...
متن کاملInformation-Theoretic Multiclass Classification Based on Binary Classifiers - On Coding Matrix Design, Reliability and Maximum Number of Classes
In this paper, we consider the multiclass classification problem based on sets of independent binary classifiers. Each binary classifier represents the output of a quantized projection of training data onto a randomly generated orthonormal basis vector thus producing a binary label. The ensemble of all binary labels forms an analogue of a coding matrix. The properties of such kind of matrices a...
متن کاملChannel Optimized Quantization of Images over Bursty Channels
| A DCT-based combined source-channel coding system is proposed for transmitting grey-level images over a binary channel with additive Markov noise. It consists of a channel optimized quantization scheme that exploits the channel memory by incorporating the characteristics of the correlated noise in the quantizer design. Experimental results show that this simple system { which employs a xed zo...
متن کاملAccurate, Non-integer Bit Estimation for H.265/HEVC and H.264/AVC Rate-Distortion Optimization
Lagrangian Rate Distortion Optimization (RDO) is widely employed in modern video encoders such as H.264/AVC and H.264/AVC for mode decision. During the RDO process the distortion and bit rate of each mode has to be estimated and more an accurate estimation leads to better optimized decisions. This paper explores accurate, non-integer bit estimation and its impact on better RDO. Simulations show...
متن کاملA Low Power and High Performance Ebcot Architecture of Jpeg2000 Encoding
We propose an architecture for Tier-1 of Embedded Block Coding With Optimized Truncation (EBCOT) in the JPEG2000 standard. The architecture is composed of a 16-bit parallel context generator and a 3-stage pipelined binary arithmetic encoder. The former is designed for low power consumption. The later is used to achieve an high throughput. The design is verified on an AMBA-based system as an acc...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1703.02641 شماره
صفحات -
تاریخ انتشار 2017